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ABSTRACT 

"Trade-offs" is an instructional television series of 
15 programs designed to improve and expand economics instruction in 
fifth and sixth grade class-rooms in the United States and Canada. 
This paper reviews 15 studies that have examined the impact of the 
"Trade-off" series, and seeks to determine how the series affects 
student and teacher knowledge of and attitudes toward economics and 
whether they enjoy the ''Traderof f s" programs. The studies reviewed 
examined diverse variables and used a variety of designs and 
instruments. They include three studies on cognitive, attitudinal, 
and inservice training effects; one report on the development and 
validation of the Basic Economics Test; five local evaluations; and 
two studies of teacher and administrator ratings of the series. 
Findings led to the followirig conclusions: (1) the series 
significantly improves students' knowledge of and attitudes toward 
economics; (2) the series significantly improves teachers' attitudes 
toward economics; (3) student cognitive and attitudinal gains were 
further increased with teaicher inservice training; (4) teacher 
attitudinal gains were further increased with inservice education; 
and (5) the series is appealing to students, teachers, and 
administrators. Notss, references, and a comprehensive chart of 
studies reviewed are included. (THC) 
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About *Trade-offs* 



IrcKi(*offs. ' (J series in economic education for nine-to-thirteen-year-olds. consists of fifteen 20- 
minute television/film [jrograrns and related materials. Using dramatizations and special visuals, the 
series considers fundamental economic problems relevant to everyday life, 

In Its first year. "Trade-offs" was used by approximately 500,000 students and their teachers in about 
25.000 fifth' and sixth-grade classrooms. This more than quadrupled the amount of teaching of eco- 
nomics as a subject. 

■'Trade-offs" was produced under the direction of AIT by the Educational Film Center (North Spring- 
field, Virginia), The Ontario Educational Communications Authority, and public television station 
Kf;;RA. Dallas. 

Procjrams are available on film, videocassette. and broadcast videotape. 

"Trade offs'" was developed cooperatively by the Joint Council on Economic Education, the Cana- 
difin Foundation for Economic Education, the Agency for Instructional Television, and a consortium 
of fifty rhr('(» state and provincial education and broadcasting agencies. 

The Consortium 

•M<il)<im<j F TV Commission 
Airiskr! Dt'ivirtment of F-fiu( (Jlion 
Alh(»r1ri \ flue ci\)on 
•Xn/on^j De[)drtment of Kducation 
AfK,ins<is f c onomir tdiication Council 
fUitish Columbiri f)epcirlment of Education 
^ <)\iU)n\\d Consortiunri on Economic Education 
rolor'Uli) Hf'partment of p- duration 
f •ifuicrfK ut F du dtronal Television Corporation 

^luf>uf|fi thf* Calvin K. Ka^anjian Foi^jndation 
f )«'kjw<ire Chapter of ACES. Inc . and [Delaware 

Deparlmf^nt of Public Instruction 
f loridd Department of Education 
Oeor.jia State Department of Education f)ivisif)n of 

f fii j( «)tM )rMl Media 
H,jv,oii f)f'[)<^rtmenl of f-ducation 
Idcjfio Statf* Department of Education 
Illinois Office of Education Illinois Council on 

f ( ofinrnic Pdiication 
Indi.in.) ( ()un( il ff)r F f oriornir [duration Indlafiapolis 

I'uhiK S( tiools 
\nvf') Public Fkoadcastinu INetwork 
K.iiisas State [3oard C)f E (iucdtion 
K»'f)ru( kv f vjuf atiorifjl fflevision Autfiority 
I 'Miisr(Uia Oepfjrtment i)\ f (hK<3tinn 
''^ain<' [)i*partrnem of f durational and Cultural Sm.if es 
Maniroba f)epartment of Education 
Marvland State Department of Educ ation 
'»Viss<K husetts F)epartrnent of F dur ation Mcjssac husetts 

f I lijf ari< )nal f flevision 

Inq.tn f )<'[)artriient of f duration 

'•\iiiut'snfa Stfitf l)e[)artnK'nt of I dutation 

.r.Mpjij Atithonty for F (iur:']tional Television 
Missouri I )<'[)<jrtfn''r)t r)f [ k»rnentarv and Se( oruiarv 

f . <iti< jfj 
-<t't)f .jsk.j f )r»partnierit of f duration 
*'*'\ada f < nifu il on [ r ononiif I (Jur ation 
-^'••A tlani()sfMre State 0[>,irtrYient of f rkkaticn 
''•■A U'ls^'V St.jlr [ )fp^iftment of [ du( cJtion Jerscs 

l*iif)l:< Hrf>f)dr<js?inr| Npu jffsrv ('(M.iDf il on 

A f ! i- '^t.\\i' \ i|i|f I )rp.jftriH'nr 

3 

ERIC 



North Carolina State Board of Education 

The rSorth Central Council for Scfiool Television. Inc. 
The North Dakota Council on Economic 
Education-and the Fargo Public Schools 

Nova Scotia Department of Education 

Ohio State Department of Education 

Oklahoma Department of Education 

The Ontario Educational Communications Authority 

Oregon Department of Education 

Pennsylvania Department of Education 

vSociete Radio Quebec 

Rhode Island Department of Education. ETV Services. 
Channel 36 

South Carojina Department of Education Office of 

Instructional Television and Radio 
Sr)uth Dakota Council on Economic Education South 

Dakota Department of Public Instruction 
Tennessee State Department of Education 
Texas. KERA. Channel 13. Dallas; and Gulf Region 

Educational Television Affiliates. Houston 
(Jtah vState Board of Education 
Vermont ElV Network 
Virginia Department of Education 
State of Wisconsin. Superintendent of Public Instruc tion 
West Virginia Department of Education 
Wisconsin Educational Communications Board 

Contributing Corporations 
and Foundations 

American Telephone and Teleqra()h Cornp<jnv 

The Busf) F'r)undation 

\ won Corporation 

C.ieneral Electric Eoundcition 

General Mills Foundation 

General Motors Foundation. Inr 

Gulf Oil Foundation 

International Paper Company F oundatron 
I aird. Nor1f)n f oun(i<jt)< )n 
Owf'ns Illinois 

Pfiilli[)s Petroleum F ounrLitu >n 

PVCi Industries FoundatKni 

Shell ( 'i )rn()afiit's F ouncicjtiofi Ifw (;fpnf<jt( d 

(Inion C(ji[ndc ( orf)oiation 



Trade-offs: 
What the 
Research 
Is Sayuig 



Agency for Instructional Television 
Canadian Foundation for Economic Education 
Joint Council on Econonnic Education 



\ 



Acknowledgments 

This paper has been made possible by the work and 
cooperation of many people. The writer is obviously indebted to 
the authors whose studies are reviewed here. Many of them 
personally sent their work and took time to discuss it over the 
phone. 

Sincere appreciation i.s expressed to the Canadirjn Foun- 
dation for Economic Education anH to the Joint Council on 
Economic Education for their sup >ort and information. A 
special thank you goes tt>Stowe Syrnmes and John Sumansky 
at the Joint CounciTfor their valuable reviews of an early draft. 

Finally, thank you to the consortium members, corpora- 
tions, and foundations who made Trade-offs possible. Th's 
paper certainly demonstrates they have made a very worth- 
while investment. 



James Shea 



ERLC 



if 



5 



Table of Contents 

Page 

Summary v 

Introduction ^ 

The Research 1 

Cognitive. Attitudinal and In-Service Training Effects 1 

William Walstad 1 

Steven Van Bockern 2 

William Rohrer 3 

Norming Data— Basic Economics Test 3 

John Chizmar and Ronald Halinski 3 

I ocal L valuations 4 

James Roleke ^ 

Allen Stern ^ 

Thomas McKinnon 6 

Ken Van Apeldorn 7 

Arlene Zuckernick ^ 

Teacher and Administrator Ratings 8 

Michael Watts 8 

fc^leanor Vargo ^ 

Disrussion and Conclusions 1 ^ 

Mores 13 

Rpfprenres 14 

A,p[)endix -CDmprehensive Charl of Studies Inrluded 15 



Summary 



'i I ,.5 paper reviews 1 5 diverse studies that have examined the impact of 
the Trddv'ofh series. The diversity encompasses variables e-xamined. 
designs employed, and instruments used. There are certainly common ele- 
ments to some of the individual studies, but the diversit>' of the entire set al- 
lows a comprehensive examination of the series beyond the scope of any 
single study. 

The studies reviewed have led to the following conclusions about the im- 
pact of Trade offs: 

1 ) The series significantly improves students' knowledge of and 
attitudes toward economics. 

2) The series significantly improves teachers' attitudes toward 
economics. 

3) Student cognitive and attitudinal gains were further increased with 
teacher in*service training. 

4) Teacher attitudinal gains were further increased with in-service edu- 
cation. 

5) The series is appealing to students, teachers, and administrators. 



irSTRODCJCTION 

Jradv off'^ is an instructional television series of 1 5 progranns designed to innprove and expand economics in- 
struction in fifth- ^nd sixth^grade classroonns in the United States and Canada. The series was developed by the 
Acjency for Instructional Television (AIT), The Canadian Foundation for Economic Education (CFEE), and the 
Joint Council on Economic Education (JCEE). with fiscal support from 53 state and provincial agencies, 2 foun- 
dations, and 1 2 corporations. In 1 97^i, these organizations joined together to create a series that would "help stu- 
dents think their way through economic problems and increase their understanding of economics" (A Guide to 
TfcUlrofh). 

The result of this three year collaborative effort was the refease of Trade^offs in 1978. One indication of the 
impact of Tr<u Ir offs is the number of students who have viewed the series. In its initial year of use ( 1 978-79) Trade- 
offs was broadcast on 158 non-commercial television stations and was seen by over 500,000 students in almost 
25,000 fifth- and sixth-grade classrooms. In the second year of use non-commercial television broadcasts had in- 
creased to 274 stations and student viewers were also substantially increased (AIT. 1980). Additionally, while 
rf<Hir ntfs Was designed for grades five and six. there is substantial evidence of widespread use in the seventh- 
qrade classrooms. 

Beyond utilization figures for Trade offs, a considerable amount of data concerning its effects and appeal has 
been gathered by a variety of projects in the (Jnited States and Canada. Some this data has been the result of 
rirjorously designed, quantitative research that has examined the cognitive and attitudinal effects of Trade-offson 
slLidcnt viewers. Other projects have gathered information . that relates to teachers' and students* subjective ratings 
of each program in the series. Although perhaps not the result of rigidly structured research, the data from such 
studies add to our understanding of the reception of Trade offs by teachers and students. This paper reviews a 
br(u\d base of information to form tentative answers to the following questions: 

I ) How does Tfiuivoffs affect student and teacher knowledge of and attitudes toward economics? 
'?) f)o students and teachers enjoy the Tradeoffs programs? 

This reprjrt is not intended to t^ea critique of methodologies, altfiough they will be disc /ssed. It is an attempt toas- 
sifTiilritf dfui synthesize the results of the research that has been completed on Tradv offs so that we can gain a 
nifjre f ofTiprf'hensive understanding of its impact. 

r iftef^n spp^irate studies will be examined. A summary of these studies can be found in the chart in Appendix A. 
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Cognitive, Attitudinal, and In servtce Training Effects 

One of the most extensive and rigorously structured studies of ruuic offs was conducted by Willtanri Walstad 
(1979). Hrs investigation examined: ( 1 ) the effects that Trade offs had on student economic understanding and 
attitudes towrjrd economics and (2) the' effects that teacher in-service instruction in both basic economics and in 
the use of Ir^fdr o/Zs had on student learning and attitudes. This examination of the effects of teacher in-service on 
student economic understanding and attitudes is particularly relevant since many school systems have devoted 
considerable resources and time to training teachers for Tradeoffs use. 

Walstad utilized a non-equivalent control group design in this study. He divided 22 teachers and 563 fifth- and 
sl-^th-qrade students from 1 5 St. Louis-area elementary schools into 4 groups. 2 experimental and 2 control, as 
followf:: 

r.xperimental Group 1 : The students of volunteer teachers who participated in a 30-hour in-service course in 
r( r jrujf ni( s fhcsf^ students then viewed Tradeoffs and participated in limited pre- and post-lesson activities 
outlined in the teacher s guide for Trddc otK The total student instructional time over the 1 5 week treatment 
(>eriod Wf)s 10 hours. N-149 

r xpcrimental Group 2: Thv students of volunteer teachers who did not participate in an in-service course. 
These students did view //tu/r o//s and also participated in the pre and post-lesson activities. Total bludent 
instrudtona] time over the 1 5 week treatment period was 10 hours (the same as Experimental Group 1). 
rs 106 • 

Control Group 1 : Students of volunteer teachers who participated in the in-service course but did not show 
/M(/r ' >//s ) their clds« These students rec ^ed no direct instruaion in economics, other than the teach- 
er's use of the economics presented in the district social studies text. fH = l 15 

Control Group 2: Students of randomly selected teachers who neither participated in an in-service course 
nor showed hddroit^^ to their classes. Again, these students received no direct instruction in economics. 

M - 1 03 

W<ilstrul usrd the Ic^l at / Ictucntdni [ nnuvuics (TEE)' as his measure of knowledge of economics. The TEE 
rnMsureb qenfval knowledge of economics and was not specifically designed to evaluate Ttddvoffs. Walstad 
used a semantic differential instrument to assess student attitudes toward economics.^ 

In .incily/inq th<^ data. Walstad used a multiple linear regression analysis. This analysis controlled for age. sex. 
M)fnf)osite s^^orf's on an SRA achievement test, pretest economic understanding, and pretest attitude toward 
f'( onomirs. By using multiple regression analysis Walstad ensured a more carefully controlled scrutiny of the ef 

W.ilstfhJ s r^'SLilts 'otf^^r (\cK)d evidence for the value of Tnidc ofK Both the experimental groups (groups view- 
HU| Ihulc^^lf'^) showed significant positive differences in economic understanding and attitudes toward eco- 
rjor PK s whrn compared to the control groups" (Walstad & McFarland. 1 980. p. 4 1 1 ). In addition, very interesting 
roryiparisons were also made between the two ej<perimental groups and between the two control groups. 

I \]r ( (Mnprinson between the two experimental groups helps us understand the effect that teacher in-service 
tf .iin-fuj fuis on student economic knowledge and attitudes The in service training that Experimental Group 1 re- 
i i-ivihI 1 1 )nsistf»(l of a .UMiour course for which they received two hours of college credit. This group s students 
.h< AV'fl skinifif tint improvement in b>oth economic understanding and attitudes toward economics compared to 
I x^xTirnenldl Clroup?. who received no in-service training. Infact.'thecontributionofteachertraining represents a 
•M ? iru TfMsr in rrononiK a( hievement and a 57% improvement in attitudes toward economics for students in 
f x[)rrirnrf>tc]l Group 1 . on avc*raqe. over the gain for studonts in f jcprrirnrntn! Group ?*' (Walstad. 1 979. p. 1 0). 
MfhniKih ,j ^rMiour cfjurse is costly toth in time and mont^y. the concomitant inc r(vises in student cognitive and 
.jtritudtn il s( orf^s wf^ro certainly impressive 

f hr < j.it.) irulu ated n(^ sifjniticant differf^nr Ix-twrrfi (he two ^ ontrol fjrou[)s Control Group ? teachers were 
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not vDluntrt •r\ (itu' nitirr 'hrrc cjif )ups c onsisted entirely of voluntee^rs) and did not receive in service training nor 
shfjw /^)cA'»//stottif'ir studenl.s O^rilrol Group I teachers, on the other hand, received the in-service training but 
did not shf)sv /.Mi/e ' >^/s to their students. Walstad concluded from these results that. " Apparently, trained teachers 
are most effective when what is learned in in-service courses is directly applied to classroom instruction" (Walstad 
h \ fjriand. f). 411) Thisfindinrj isprobabty equally pertinent to the field of in-service education as a whole as it is 

tn /M(/c(.//s 

IhMse results led the researchers to conclude: 

Trade-offs ■ was effective m all classes, whether or not the teacher participated in an in-service course in 
('( ( )nomirs. The study also provides support for the link between knowledge and skills acquired by teachers 
dufinc] in servic e training and added quality in classroom instruction and motivational benefits to students. 

Cjivf*n th(* minimal classroom time required to use 'Trade-offs,'* this series provides a significant new 
resource for instruction in elementary social studies (Walstad C McFarland, p. 41 1 ). 

Ifi a study that closely parallels Walstad's. Steven Van Bockern's doctoral dissertation ( 1 979) examined: ( 1 )the 
eff»M t.s f)f If hir > .//son student economic understanding and on attitudes toward economics: and (2) the effects 
of \f'f\< hrr m service ^raining on student leaming and attitudes. 

Van kern s study was conducted with 2 1 sixth grade classrooms in sSioux Falls. South Dakota, randomly 
selfded frf)(n the A? sixth qrade classrooms in the city. They were then, in turn, randomlyassigned to 3group5as 
folk)Ws: 

Ciroup I (Control): 

Classes did not view rM(/en//s and teachers did not participate in in-service session. (7 teachers, 153 
students) 

Cjrf)up 2 (F-xperimental): 

feachers did not receive teaching guides or participate in in-service instruction, but students did view 
ffthli'oft^ with no follow-up activities. (7 teachers. 185 students) 

Group 3 (Experimentr^il): 

Teachers participated in ei^^ix-hour in-service workshop on 7rdd(' o//'s. These teachers viewed Ttwdc offs 
With their f lasses and presented selected activities and discussions from the teacher's guide. (7 teachers. 
167 students) 

Van Bockern measured the economic understanding and the attitudes toward economics of both students and 
tear hers Fr)r the student cognitive measure he used the Trndroffs S/nc/fn/ Fi'dltuition—Form A which was 
devektped t)y Jf)f)n RF^dmond of the North Carolina Council on Economic Education.* This 25-itern multiple 
c hoice test measures students" cognitive outcomes after viewing Trddroffs Since Van Bockern could locate no 
measure of student attitudes toward economics, he constricted an attitudinal test that he called the StLidcnl\ 
I ( .if)nr}}ii ^MUliuic Swn This survey contained eight statements reflecting negative attitudes toward eco* 
funnit s and eicjht statements refle( ting fxositive attitudes toward the subject. Student responses to these state- 
ments were recorded on a Likeit type scale. The teachers' attitudes toward economics were measured with the 
' ;(/rs//'inMc//Vc ( tf f ( ()ru)fr]ic ( /n(/ers/cin(//na This 1 7-item instrument measures teachers' attitudes toward the 
study ni eronomics utilizing a 1 ikert type scale. The teachers' economic knowledge was measured with the TcsV o/ 
/ . . / ih'f.u if which was developed by the Joint Council on Economic Edu«' ation.'' It is cortiposed of 46 

multiple ( hni( e questions to measure learning of economic concepts. 

In analy/inf) the data for his study. Van Bockern used multiple regression analysis to control for students' sex. 
lutelhrjenc r ()uf)tients. /o/im /es/ of Bn^K SA'/Z/s reading scores, pretest scores, and their teachers* past economic 
[>repfKatinn This data indicated that viewinc] fMc/r n//s alone, with no follow up discussion or activities, produced 
sKjnifK ririt positive effects on students' economic attitudes and knowledge when compared to the control group, 
f or^fierrnnre. spendincj a greater amount of time with /^^c/e n//s "through discussion and activities and having 
\f\v hers rittend cU) m servjce workshop on the series Increased the students" economic attitudes . . . and economic 
kfK wtien f ompared with students simply viewinr] th(* series" (pp 96-97). He also found that the series had 
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c\ measurable, positive impart on the teachers' economic attitudes, and the teachers' attitudes were even more 
substantially improved l>y the in-service workshop. Howe\'er. Tradeoffsd\d not, either alone or in conjunction with 
the in-service workshop, have a measureable effect on the teachers knowledge of economics. 

A study by William Rohrer of the Washoe County Schools (Reno, Nevada) examined the effects of Trade offs 
on sixth^grade students understanding of economics. The purpose of this study was to investigate the effects of 
TmdC'Offs upc. , . ermediate students and "to compare effects of economic understanding with problem-solving 
abjlity and attitudinal char^ges" (p. 2). Rohrer also examined the effect socioeconomic status had on the results. 

His sample included an experimental class (total N - 126) and a control class (total N= 92) at each of four 
middle schools. The teachers of these eight classes had no previous economic in-service training (their level of 
preservice training in economics was not specified). The experimental groups used all 15 fradc oZ/is programs 
with the accompanying materials from the teachers' guide. The control groups consisted of the traditional social 
studies classes. 

Students' economic understanding wias measured with the Trade offs Test,'^ The Tradeoffs 7es/isa measure 
of students understanding of the economic principles presented in the series. The problem-solving test was 
cidapted from Shann's Measuring Problem Skills and Proce^sses in Elementary School Children,^ Semantic- 
differential instruments patterned after Walstad's (1978) were used to measure attitudes toward free enterprise, 
free market, and large corporations/big business. No reliability data was provided for these instruments. 

To determine socioeconomic status, "weighted ratings were assigned for parents' occupation, parents' in- 
comes, parents* education, and dwelling place" (p. 4). Rohrer then used these ratings to determine the relationship 
of socioeconomic status to the other variables^ in his study. 

Rohrer utilized both an analysis of covariance and a multiple regression analysis to analyze test results and 
variable interactions. The multiple regression analysis examined the interactions of socioeconomic status, Trade 
offs instruction (yes or no), problem-solving pretest, attitude toward free enterprise pretest, attitude toward free 
market pretest, attitude toward big business pretest, and economic understanding pretest on the changes (from 
pretest to posttest) in economic understanding, problem-solving ability, attitude toward free enterprise, attitude 
toward free market, and attitude toward big business. ^ 

The data indicated that Trade offs definitely increased the economic understanding of these sixth -graders. The 
difference in the means of the experirpental and control groups was significant. The multiple regression analysis 
revealed that the differences were due neither to socioeconomic status nor to attitudes. 

T he results were somewhat mixed when Rohrer tried to determine the relationship of econopnic understanding 
to problem-solving ability. The analysis of covariance revealed no significant differences in means of the control 
and the experimental groups. The multiple regression analysis, however, revealed that the posttest score for 
students viewing Trade offs and the change in economic understanding from pretest to pr ^st have a significant 
reciression coefficient with the change in problem-solving skills. Rohrer hypothesizes. " Trade offs, itself, may not 
have a positive effect, but economic understanding does show some positive relationship to gain in problem- 
sfMVfnq ability * (p. 8). More researches needed, according to Rohrer. 

finally. Rohrer found that Trade offs instruction significantly increased the students' positive attitudes toward 
free enterprise and the free market. Attitudes toward big business were not significantly affected. 

Thus. Rohrer's study revealed significant increases in students' economic understanding when Trade offs was 
used. The data were inconclusive in determining the relationship of these cognitive increases to problem-solving 
ribilitv Attitudes toward free enterprise and the free market were significantly more positive while attitudes toward 
\)U\ [Hjsiness were not 

Norming Data— Basic Economics Test 

In r) study of a decidedly different nature. Chizmar and Halinski (1979) gathered considerable data in the 
(VHirse of validating an achievement test that would update the Tes/o/" F/(:v77(*n/da/r('onom/c.s(TEE).TheTEEis 
iin .K hievement test of basic economics principles develop>ed in 1 97 1 for intermediate grades. (The TEE was em- 
plf^ved in the study by Walstad reported on p. I. See note I .) In light of the many curricular advances in economics 
over the pdst decade the Joint Council on Economic Education decided In 1 978 to revise the TEE. The Basic 
I : ..n»'M/f rcsf(F^r'T) was the result of this effort It was developed byJohn Chizmar and Ronald Halinski with "in- 
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put (rofTi d vrinoty t>f profirssionals. both within and without economic education, at each stage of developnnent" 
(1979. p, 2). Additionally, d working conrunittee, consisting of public school teachers, university professors, and 
other educational specialists, was fornned for the initial writing of itenns and selection of items from the item pool 
for the pilot instruments. 

One of the curriculum developments of the past decad^ that greatly affected the development of t tie BET was 
the release of Trric/c o//:sin 1978. A Guide to Irdc/e oA/^s was one of "three source documents, descriptive of 
current ( urrirular thinking in economic edaattio/f'- (Chiznriar and Halinski, p. 3) used as a basis for develop! ng test 
items (the other two being Thv Mtister Curriculum Ciutde in Econonvc^forthe Nation s Schools, Parts I and ID> 
Dwelopment of a national achievement ti?st of this scope is a massive undertaking requiring an extremely large 
pilot testing of the two forms of the instrument for norming purposes. Towards this end. "2,0.000 tests were mailed 
out; 9,000 for students with instmction In economics and J 1 .OOOfor students without such Instruction. . . . Approxi- 
mately 53% of economic education in the norming group was Trade-offs, while approximately 46% was identified 
as other"" (p. 5 and p. 13). This is an indication of the widespread use of the; tries as a primary means of eco- 
nomic eduration. This norming data was collected from classes in 56 school d stricts. 

One of the guidinq principles in the developmental process of the test was that, since the test would occupy a 
mrijor role in evaluating the effect of economic instructior>rthe items . . . needed to be responsive to classroom i n- 
struction ' (p. ?). Since Trade offs represented the pri man/ means of economic instruction for over half of the 
norming group classified as "with instruction," a cor»4iderable amount of data (much more than any study re 
fxjrted in this review) was gathered on Trade offs during Ifye development of the BET. 

In analyzing theTesponse of the BET to instrijction^ ther^esearchers controlled for several intervening variables 
by utilising an analysis of variance. The analysis of varfanc/used the variables of score (individual student score on 
theEiET). instruction (defined as at least 1 week of instruction. 13 or more weeks of instruction, or otherwise), sex 
of student, grade level (five or six), and the interaction of the sex of student and instruction*. The first analysis of 
vcinance indicated that the BET does indeed respond to instruction. This first analysis did not. however, allow 
Chi/mar and Halinski to examine the impact of extensive instruction on BET scores. A second analysis of variance 
was performed. that indicated the BET does increasingly respond to increasing amounts of instruction. The 
authors then performed a t test of the differences between the mean scores pf the T'rrjdeo/'As students and the stu- 
dents identified as "bther/' "On both forms, the results indicated that those/eceiving Trade-off^ instruction did 
skjnifif dntiy N'tter ' (Chi/mar and Halinski. p. 32). In probing for confounding variables, however, the authors 
hvfxMhesi/rd \\u}\ perhaps students using Trade-off^ received more instruction than students using other in*' 
.struction. They performed a t-test comparing the (differences between the groupsin mean weeks of instruction, "in- 
(U^vd, students using Trade offs did receive significantly more instruction" (Chizmar and Halinski. p. 33). 

I hu*' \\\v r*'sijlts of this rfiost ej<tensive data gathering effort by Chizmar and Halinski indicated that Tradeoffs 
siynitirdntiy improved student scores on the BET. It also indicated that the Irade offs group received more in- 
sTnjf tion. One must bear in mind, however, that gathering data on the effectiveness of Trade-offs was not their 
I .nnirin/ purfx )Sfv Their primary purpose was to demonstrate the development of a reliable and valid achievement 
t(-st IN()fi<»thf|pss. a corisiderahle .amount of data regarding 7/dc/(' ()//s was gathered that helps us to uncierstand 

fffrcTs f)f the senes. 

Local Evaluations 

I Af) stnrlifs. one from K^jnsas Cily. Missoun and one from Minnesota, wrrr produced as part of lar(jer t(fle- 
vr.M "ti ••vdlurition ,u tivitits in Ihosf locfjlions. 

I In* K.ifis.js City. Missouri public school system irnplemente-d the //dc/r n//s series as part of a large scale in- 
.trri. iK.rifil [r((>visif)n project. The prcxjrams were viewed hv dp(?roxirnately 1.400 students in 17 schools. The- 
Mwirnity f)\ rhf'Sf students (89T,) were in grades, four. five, or six. with ^% in grade five. A considerable amount of 
.l.jf.i un f'.hli^ .//s was rjath^TPfl ir^ the ( ourse of the evaluation of the television project. These data included stu- 
ih'fit , (>r»*trst riful postteM v ores <mk\ sun/eys of both tcvuhers and stud^'nts' reac lions to ttu^ s^^ies Thedatruire 
■{♦■t.jtK'd h; rf'[)ort [>r('parfd by James Roleke, the F valiitition Coorduuitor for the school distnct. 

I he sfudcf^t^ f r)rii[)let(^d [)rHest ln^Se[)te^nber rind a [x^sttest in Mc^v. in between testintj the students viewed 
'I).- ».M!r--. hot itu' r-xtf^nt of follow Up tjvities wris spec ifi(^(l On \\)e Missouri Council on [ rorioniic IcMic a- 
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tion's 7('s< ofFconnmics in Trade offs.^ the average gain achieved by the students was 1 Q%. Although no control 
group was used, the scores of the students who viewed the series were increased. 

In addition to the cognitive testing, a survey was connpleted by 1 ,206 of these students. The students indicated 
whether they agreed with, disagreed with, or had no opinion about each often statennent' Since not all of the state 
mentsTelated directly to Trade offs, we will report only the results that did. Most of the students (84%) agreed with 
the statement. "I enjoyed the Trade offs programs." Even more (86%) agreed with. "I thinik leaming about eco- 
nomics is important." Many (75%) agreed they had leamed a lot about economics during the year. However. 52% 
indicated some of the Trade offs programs were difficult for them to understand (the majority of the students 
surveyed were fifth graders). Thus, even though over half of these students said some of the programs were too dif- 
ficult for them, the majority (75%) indicated they had leamed a lot about economics during the year. 

Additionally, teachers responded to 35 statements using a 5-point scale from "strongly agree" to "strongly dis- 
agree." Most of these. items did not relate directly to Trade offs so we will report only those that did. The over- 
whelming majority of teachers (98%) either strongly agreed or agreed with the staterfient. "The Trade-offs series, in 
general, was an effective instructional tool." However, the teachers were clearly divided on the item. "Some of the 
Tr.uk' nffs prdgrams were too difficult for the students." Although 36% agreed or strongly agreed with this state- 
ment 42% disagreed or strongly disagreed. Another 24% had no opinion on this item. Interestingly, only 26% 
agreed or strongly agreed with the statement. "Most fifth graders are not able to understand the economic con- 
cepts presented in Trade offs." A majority ofthe teachers (67%) disagreed with this statement. These data suggest 
that teachers believe fifth-grade students understood the overall concepts presented in the series, but the content 
of certain individual programs was too difficult for their students. Generally, however, teachers were unanimous in 
declaring Trade offs "an effective instructional tool." 

Thus. *he results of the ITV evaluation in Kansas City showed that Trade offs increased students" economic 
understanding— as shown on the Test of Economics h Tradeoffs— hy an average of 1 8%; that students enjoyed 
the series and thought they had leamed a lot about economics from it; and that teachers overwhelmingly agreed 
the series was an effective instmctional tool. However, data from both student and teacher surveys indicated that 
some of the programs were too difficult for fifth-grade students. 

A report by Allen Stem ( 1 980) of the Center for Econonfiic Education at the University of Minnesota presents a 
wealth of daia concerning Trade offs activities in Minnesota. Stern's report examined "the number of cooperating 
schools and school districts, the amount of television broadcast time devoted to the series, the number, locations, 
and effects of economic education graduate level courses and awareness workshops relating to Trade offs, and 
the impacts of these activities on the teachers and students involved in the effort" (p. 1 0). The report is comprehen- 
sive in detailing the impact of Tradeoffs in Minnesota. Sections of the report that are of interest here are two quanti- 
tative studies and the subjective ratings of the series by teachers. Readers interested in other data are referred to 
the full report by Stern. 

Teachers' ratings of the series were gathered from a sample of over 500 teachers in Minnesota who had been 
introduced to the series through one-day workshops. These workshops were designed to familiarize teachers with 
the series by "demonstrating Trade offs films and associated leaming activities, and by providing participants with 
supporting curriculum materials"' (p. 5). Of these teachers 252. who were preselected for evaluation, completed a 
standard form. The teachers rated the series on a 1 -to-4 scale, from "very worthwhile"' to "worthle?s." All teachers 
rated the series as ""very worthwhile"" (69.9%) or "worthwhile" (30.1%). These subjective teacher ratings of the 
series are certainly impressive for their unanimously positive results. ,^ ? 

The Minnesota Center also conducted two studies to determine the effeJ«6 of the series, in addition to its 
tedcher appeal. One study sought to determine the impact the series had on teachers' knowledge of economics 
cincl on their attitudes toward teachii ig economics. The other study sought to determine the effect of the series on 
student economic literacy. 

The teacher study included 25 elementary a,hd middle school teachers from 21 schools. The teachers volun- 
teered for a 30-hour 1 2-day course . economics at the University of Minnesota. The in-service course covered the 
tecichinfj of basic economic concepts: the use of the Trade offs series; and discussion strategies and supple 
mental activities. 7"he focus was Tradeoffs. arth(jlgh supplementary materials were introduced. 

The teachers were pretested on the first day of class. The cognitive measure employed was The Test of Eco- 



JTrHiiirL ili'iiH ij (s^e note 6). The TEL is a measure of general economic ability not specifically designed to assess 
IfculcofK The cmitudinal measure employed was The Teaching Economics TesV^ This test is a semantic dif- 
ferential instrument that measures teachers' attitudes toward the teaching of economics. The teachers were 
posttested on the final day of class. ^ 

The group means^ were compared using a simple t test. Both teachers' knowledge of economics and attitudes 
toward the teaching of economics were significantly improved by 'he workshop, of which the central focus was 
Trade- of f^^. 

The student study involved 1 73 fourth-grade students from 3 elementary schools. The experimental group 
contained 90 students and the control group contained 83 students. The experimental group was taught by 4 
teachers who had been trained in either a 1 -day workshop or in the 30hour course described above. The study did 
not compare the scores of students whose teachers had received one of the two types of training ( 1 -day Nyorkshops 
or 30hour course). Although it would have been interesting to compare the results with varfable amounts of train- 
ing, the small number of teachers in each group precluded a reliable comparison. The control group was taught by 
teachers who had not received any Trade offs relatec instructional training. These teachers used ohty traditional 
district materials in their classrooms. Both groups of students were pretested and posttested with the Primary Test 
fof f cnnomic 'C]nderstanding(FTELi), ^ ' The PTEG is a measure of general economic cognitive ability and was not 
specifically designed to measure the effects of Trade-offs. There was a 4-month interval between pretesting and 
posttesting. 

Both groups" scores increased on the PTEG.' Even though the scores of both groups increased, "the students 
using Tradeoffs exhibited significant growth over and above the growth which occurred in students using only 
traditional materials" (p, 12). 

Based on the results of these two studies. Stern concludes: 

that "Trade offs" can be an effective tool for raising the economic knowledge of both teachers and students/ 
"Tradeoffs ' also improves teachers' attitudes about teaching economics and thus contributes positively 
towards teacher's inclination to use more economics in *heir classes (p. 13), 

Stern go^es on to strongly recommend that the use of Trade-offs in Minnesota classroonris be continued. 

In a study on a much smaller scale. Thomas McKinnon examined the effects of Trade-offs with a group of 63 
seventh grade students and 1 teacher. The teacher was assigned to teach an orientation course that included 
instruction in economics, but she had neither; preservice nor in-service training in economics, 'The objective of 
this study was to determine if teachers untrained in economics could effectively teach economics witli the use of 
the Trade offs films and teacher s manual. A secondary objective was to determine if students develop favorable 
dttitudes toward economics under these circumstances * (p. 2). In the context of this review, the most interesting 
variables of the study are: ( 1 ) it was conducted with seventh-grade students and (2) the teacher had neither pre- 
service nor in-service training in economics, \^ 

The design was a simple pretest/treatment/posttest design. Mo control groups were used. The 
methodological limitations and small sample severely restrict the extent to which these results may be generalized. 
rSonetheless. information was gathered that will a^d to our growing bankof knowledge about the variety of condi- 
tions under which Trade-offs has been implemented and the results obtained under these various conditions, 

McKinnon. like Van Bockern, used the Trade-offs Student Evaluation developed by John Redmond of the 
)nh Carolina Council on Economic Education as his cognitive measure (see note 3), McKinnon developed his 
own tittitude srdle containing ^iight items that examined students' reactions to" the series. Since it was series- 
sf)er ific, the attitude scale was administered only after the students had viewed Trade-offs. 

AV. Kinnon found that on {\he cognitive measure the students' "posttest was a statistically significant improve 
rnent over the pretest" (p. 4). On the average, the students' scores improved by 19%, Cognitively, these students 
made significant gains** 

^!r?re comparative data were not available for the attitude scale, this information was simply tallied. McKinnon 
c one lu- i: from the tally that. "On the whole students indicated that they found the films about average. However, 
fhev felt that fhey had learned a good bit about economics and thought that all students, even their younger 
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brothers and sisters should see the films" (p. 4). Certainly, the scores on the cognitive measure support the 
students" feeling that they " had learned a good bit about economics." 

McKinnon concludes from these results. "This study indicates that teachers untrained in economics can ef- 
fectively, teach economics principles utilizing the Trade-offs film series However, further evidence is needed 

before strong conclusions can be drawn" (pp. 4-6). Indeed, the methodological limitations and small sample pre- 
clude-, any widely generalizable conclusions being drawn from this study. For purposes of this review, however, \ 
McKinnon s study demonstrates that Trade offs can be applied in some seventh-grade settings and that a teacher 
untrained in economics can successfully implement the series. 

In a Canadiah study. Ken Van Apeldom conducted a pilot test of Trade offs^ih 1 2 teachers and 285 students 
in 4 school districts in British Columbia. This pilot study sought to determine students and teachers' reactions to 
the series so that specific recommendations could be made for most effectively implementing the series in these 
districts. 

The teachers in this study attended a one-day orientation meeting where they were introduced to the series, 
were given some background information, and \yatched two of the programs. Following this, the teachers "were 
asked to take ire programs with the guide and appty them as they saw fit" (p. 1 ). iNo control groups or cognitive 
measures were emplbyed in this study; implementation, not research, was the primary motivation. 

This project included grades 4 (fN = 22), 5 (N = 78), 6 (fS = 74). and 7 (rH= 66). Both students and teachers in 
these grades were given questionnaires to determine their interest '»n the series and its relevance to them. 

Since this project was to make specific implementation recomm* dations, a steering committee was formed. 
It was composed of four teachers and a faculty member from the University of Victoria. Based on the information 
Van Apeldorn and his associates gathered, the steering committee concluded: 

The response of the 1 2 participating teachers and 285 students to Trade-offs was overwhelmingly positive. 

The series is consistent with the core curriculum emphasis on developing problem-solving skills. 

The series is generally most appropriate to students at the grade-seven level. 

Teachers generally felt comfortable using the programs and guide. 

The series comes closest to conforming in content and methodology (i.e. the inquiry approach) to Social 
Studies curriculum. 

The guide, although generally well-organized, should be revised to incorporate changes agreed upon by the \ 
steering committee. i 
Many fourth- and fifth-grade students indicated on the questionnaires that some of the programs, particularly the 
later ones, were too difficult for them. Additionally, five teachers in the fourth and fifth grades indicated their classes 
had difficulty with the later lessons. Based on these results, the committee recommended the series be used in 
seventh-grade classes. 

An extension of Van Apeldorn s pilot effort was conducted in British Columbia by Arlene Zuckernick during the 
following year ( 1 979- 1 980) and sought to further clarify and extend the information that was gathered in the pilot 
year. In all. 1 5 teachers from 3 cities participated in the evaluation, which involved 324 students in grades four 
through nine. Due to absences. 286 sets of student questiorinaires were returned, of which 1 1 5 were coded and 
analyzed. These students represented 7 different schools. The grade distribution was as follows: fourth — 10.4%; 
fifth ' 1 C)3%'. sixth -9.6%; seventh— 44.3%: and ninth— 1 9. 1 %. In terms of the current review this sample is unique 
in that it includes grades four and nine. 

The students c ompleted a pretest, a midpoint test (after viewing programs one through eight), and a posttest 
(after viewing p)ro<:jrams nine through fifteen). The tests were investigator-developed and no reliability data were 
provided The instruments were surveys, not cognitive measures. Viewing^situations and frequency of viewing were 
not controlled, although 75% of the classes viewed orie program per week. 

r he teachers completed a pretest, a weekly checklist after each lessbn was complete, and a final questionnaire 
at \hc r onrlusion of the 1 5-prograrn unit. Although 80% of these teachef^i h^id taught five years or more, most 
(S8%) had not taught economics previously: half of them had taken university level courses in economics. 'The 
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tear hers were erit cjuraqed to discover or develop additional material during the experimental period. It was also 
left to the mdividudl te'dcher's discretion to eliminate any program deemed inappropriate for their class use" (p. 4). 
In general, the teachers were provided a considerable amount oi freedom in this design. The intent of Zuckernick's 
' evaluation, like that of Van Apeldorn s, was to provide information to local decision makers. 

During the course of the 1 5-program unit, there wasa significant increase in thestudents' perception of the im- 
portance of understanding economics. The students were also asked "if and with whom they discussed eco- 
nomics* (p. 7). Student responses indicated a significant increase in the discussions of this topic with parents and 
teachers although they reported little change with respect to friends or siblings. Thus, according to student results. 
" Trade-offs increased the students' positive attitude towards economics and their actual discussion on economic 
issues" (p. 7). 

Furthermore^here was a highly significant increase in the students' perception of how much they learned 
about economic principles during the course of Trade offs. The students also responded to an item that 
attempted to measure their comprehension of the decision-making model presented in the series (neither 
reliability nor validity data were presented for this item). No signifjcai;^t change was found in responses to this item 
from pretesting to .posttesting. Even though the students' [perception of how much they learned during the course 
of Trade offs increased significantly, no significant change was noted in ''their ability to state thedecision making 
model enumerated in the Tradeoffs episodes" (p. 8). 

Generally, the Trade offs programs were favorably received by the students, especially in comparison to other 
classroom lessons. Half of the students indicated they would like to have more Trade offs lessons if they were 
available. Half of the students also indicated they had told friends in non-Trade-offs classes about the series. 
Finally. 45% thought the unit was "more enjoyable" than other classroom lessons. An additional third (32.3%) 
thought it was at the "same level of enjoyment." 

The teachers, who completed a pretest, a checklist after each lesson, and a final questionnaire, "initially 
underestimated the length of individual classes" (p. 1 1 ). In the lesson plans the average time allotted for a class 
was 55 minutes, but the average lesson took 80 minutes, plus 30additional minutes of teacher preparation, Since 
the programs are only 15 minutes, an additional 65 minutes, on average, were devoted to each lesson. Even 
though each lesson took a fair amount of planning and classroom time, the teachers seemed to feel it was time ef- 
fectively spent. "The majority (7556) felt that the Trade o/Zs lessons were 'more' or 'equally enjoyable to teach than 
similar units and 'equally successful' in comparison to similar units" (p. 1 2). Teachers indicated that the length of 
prc^paration time was the most difficult aspect of each unit, while "the motivational aspect of the programs to 
stimulate the students* interest was consistently cited as its greatest strength" (p. .12). Finally. 80% of the teachers 
indicated they thought grade seven was the most appropriate grade for implementation of the series, regardless of 
what the teacher's own grade was during the project. 

Teacher and Administrative Ratings 

In another study. Michael Watts (1979) examined teachers* and principals* reactions to the 7radeo//s series in 
<j 2 day workshop totally removed from the classroom setting. The 39 teachers and 3 elementary principals from 
Indianapolis. Indiana viewed each program in the seriesand completed an evaluation for each program and for the 
entire series. Since this workshop was a brief, intense experience for the 'participants, the ratings had to be 
assigned with little time^for reflection. But Watts notes that: / 

these teachers should \be seen as trained professionals with respect to materials evaluation, and 1 1 of the 
(Mrticipants had attended formal workshops on economic education/where other economic education 
materials had been examined and evaluated. In other words the participants* ratings should be taken as im- 
pxDrtrint evidence on the effectiveness of these materials— certainly tn^groups responses can be seen as 
important in that if classFoom teachers and principals reject a set of rfiaterials it is unlikely they will ever be 
used (p 2), 

Additionally, the ratings of this group are interesting because of the variety of grade levels taught by the teachers , 
and because the group included administrators. The distribution of participants by grade taught was as follows: j 
Pnman/ (first through third)— 3; Intermediate (fourth through sixth)-21: Junior High (seventh through ninth) — ^ 
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14: Senior High (tenth through twelfth)—! ; Principals— 3, With this range of participants Watts tried to deternnine: 

1 ) Do teachers and principals like the filnns? 

- -2) Do they agree that the economic content of . the. filnns js meaningful? 

3) Is the teacher's manual adequate? 

4) In what grade levels can the series be most effectively used? 

Watts collected background data on the participants' sex. prior participation in economic education programs, 
test scores on the JCEE's Test of Economic Literacy (see note 6). grade levels taught, and rough data on the 
reading levels of the students in the participants' classrooms. He used a multiple regression analysis in examin- 
ing his results, which "do not suggest that these personal characteristics are systematically related to selected 
measures of the participants' evaluations of the materials" (p. 2). 

Watts had the participants rate each program of theseries on a ^-point scale with 5 = excellent. 4 - good. 3 = 
fair. 2 ^ poor, and 1 = bad. The average rating for all the films was 4. 1 . "In general, then, the films scored V^ry high 
marks from these teachers and principals " (p. 2). Participants completed these ratings at the conclusion of each of 
the 1 5 programs «hown. 

The teachers also indicated what they thought the most appropriate grade level for each program would be; 
Watts concludes from these results: 

Clearly the films are perceived^ by this group as suitable for junior high grades. . . , Responses to this item in 
the questionnaire were typically given as some range of grades (e.g. 4-7), and taking the average of the lower 
end of these ranges indicates that the participants did feel that most of the films could be used at the 
(targeted) intermediate level (p. 3). 

These participants felt the series could be used for junior high as well as intermediate levels. 

In addition to rating each program, the participants completed a summary questionnaire. On this summary 
questionnaire the teachers indicated that: 

. 1 ) The economic content of the series was irinportant and effectively presented. 

2) The teacher's manual was useful and usable. 

3) Their overall rating of the Trade-offs material was high (4.2 on the 5-point scale). 

Also, based on their experiences in this workshop, "the teachers strongly indicated that they would use at least 
some of the frddc offs films in their classes" (p. 3). 

Eleanor Vargo ( 1 979) of the Lambton County Schools in Ontario, Canada gathered teachers' reactions to the 
series by piloting the series with 1 4 fourth-, fifth- and sixth-grade teachers. Working with these teachers on a regular 
b<5Sis. Ms. Vargo regularly received feedback on the series. Based on these experiences, she drafted the following: 

The consensus of this group was that the series was highly useful, appealing, and stimulating. The students 
were involved in discussions and follow-up activities which focused on decision-making skills apd the in- 
troduction of economics concepts such as money, prices, employment, production, etc. It also aided 
students in understanding human behavior All the teachers involved indicated their willingness to use the 
srries rtqain and to recommend it highly to other teachers. They felt the teacher's guide to be very useful and 
c)p[)ropriate. There was some feeling that programs nine through fifteen, although still enjoyed and dis- 
cussed by the students, contained more advanced concepts and the classes could not make as full use of 
the follow-up activities. These programs might be more useful in intermediate grades. This would present no 
[)roblem as the material is not sequential (p. 1 ). 

Vcirqo goes on to recommend that program^ne through eight be viewed in grades five and/or six and that pro- 
t)raf7is nlnf^ through fifteen be viewed in grades seven and/or eight. 

As part of fior report. Vargo Included some c omments by teachers who had used the series. Since this review 
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hcih reported so rnuc h "second-h<ind" evidence of Trade-offs effectiveness, it seenns fitting to include some "first- 
hand," personal responses by a group of teachers. These comnnents by a group of Canadian teachers \ncluded; 

—My Grade Fours enjoyed discussing the shows and learned sonnething from each one. 

-The Grade Fives really enjoyed the techniques of dramatizing a situation, 

—Tfie student interest and excitennent of the programs was more than encourar'ng. 

—The programs were extremely relevant. 

—My students willingly missed recess to see it. 

—We solved classroom problems using the techniques dramatized— with excellent results. 
—Many values issues were raised and discussed with encouraging results. 
-I would gladly use further programs of this type. 
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DISCUSSION AND CONCLUSIONS 



This review has examined information from 1 5 separate studies and/or surveys. The stated purpose of review- 
ing "IhisdiveriSe mass of information was to fomi tentative answers to two questions: 

1 ) How jioes Trade offs affect student and teacher knowledge of and attitudes toward economics? 

2) Do students and teachers enjoy the Trade offs programs? 

In thi^ section we will integrate these findings and draw some conclusions based upon the results of these studies. 

Seven studies (Walstad, Van Bockem, Rohrer. Roleke. Stern, Chizmar and McKinnon) that examined Trade- 
Cflfs eftipcts on students* economic knowledge were reported- Five of these seven studies (Walstad, Van Ek)ckern. 
Rohrer. \Stern. and Chizmar) compared the performance of students who were in classes viewing Trade-offs with 
classes lusing traditional materials. In each of these studies, students who viewed Trade offs performed 
significantly better than their counterparts who used the traditional materials. The remaining two studies (Roleke, 
McKinnipn) compared the pretest and posttest scores of students who ha<;l viewed the series; no control groups 
were used. Again, these results indicated statistically significant improvement in the students' scores. Based upon 
these consistent findings of seven researchers in seven different locales, ther6 is ample evidence that Trade offs 
improves student understanding of economics and that this improvement is Statistically significant when com- 
pared to students being taught with traditional materials. \ 

Two of those six studies (Wals'iad and Van Bockern) investigated the effects orteacher in-service training on 
students' economic knowledge. The in-service training the teachers received rangefe) from a 6-hour workshop 
which covered only Tradeoffs use (Van Bockern) to a 30-hour course that covered basic economics principles in 
addition to the use of the series (Walstad). Both studies indicated further increases in student cognitive gains, with 
Walsta'd's study indicating a 93% increase in student cognitive test scores over students viewing the series with un- 
trained teachers. Although each of these studies needs to be replicated before firm conclusions can \:>e drawn, 
their preliminary findings indicate that teacher in-service training in the use of Trade offs produces further 
significant gains in student economic knowledge. 

Three studies (Walstad. Van Bockern. and Zuckernick) that examined 7"rade-o//s effects on students' attitudes 
toward economics were reported. Walstad and Van Bockem both found significant positive changes in students 
attitudes toward economics. In both studies these changes were further increased when the teachers involved re 
ceivedjn service training. Zuckemick also found the series significantly increased students' positive attitudes 
toward economics. Students also reported increases in their actual discussion of economics with parents and 
tparhpr-^. Additionally. Rohrer examined student attitudes toward three specific variables, free enterprise, free 
market, and big business. He found the series significantly increased students' positive attitudes toward free enter- 
prise and free market, while no change was found in their attitudes toward big business. Thus, the evidence 
indicates Trade-offs produces significant positive change in students' attitudes toward economics, and even 
greater positive change when their teachers receive in-service training. 

Two studies (Van Bockem and Stem) examined the effects of the series on teachers' knowledge of and at- 
titudes toward economics. Stem measured teachers' economic knowledge and attitudes before and after a 1 ?. day 
workshop devoted to econonriics educatiorlthat highlighted the series. At the conclusion of this workshop both the 
teachers economic knowledge and their attitudes toward economics were significantly increased. Van Bockem 
found that the series alone produced significant gains in teachers' attitudes toward economics and that these 
(jains were further increased by in-service training. However, he found that the series did not, either alone or in 
conjunction with in-service training, prcKtucelsignificant gains in teachers' knowledge of economics. Thus, these 
two studies both point to significant positive change in teachers' attitudes toward economics when the series is 
used in conjunction with in-service training. However, they produced inconsistent results in comparing teachers 
knowledge of economics: Stern found significant improvement in teachers' ktiowledge of economics while Van 
Eiockern found no measurable differences in teachers' knowledge. These findings should be interpreted very 
cautiously since the difference in designs, particularly the length and content of the teacher training, probably 
preclude direct comparisons. ^\ 
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Certdinly. all of tht* researc h that was available to us points to significant increases in students' understand- 
ing of and attitudes toward economics when Tiadv offs is used, with further increases when the teachers involved 
received in-service training. 

Yet even with these docunnented increases in student attitude and understanding, it is innportant that students 
and teachers like the series to insure its continued use. Accordingly, several investigators examined students' and 
t^^achers subjective reactions to the series. 

Six investigators (Stern. Roleke, Vargo, Van Apeldorn. Watts, and Zuckemick) surveyed teachers for their re- 
actions to the series. The results of all six teacher surveys were very positive. All of the 225 teachers surveyed by 
Stern rated the ser**?s "very worthwhile" (69.9X) or "worthwhile" (31.1 X). The 39 teachers and 3 principals 
surveyed by Watts ri.ied the content of the series as innportant and effectively presented and strongly indicated they 
would use the series. The overwhelnning nnajority (98%) of the 42 teachers surveyed by Roleke indicated the series 
was an effective instructional tool. The 14 teachers contacted by Vargo indicated the series was highly useful, ap- 
pealing, and stimulating. The 1 5 teachers survey^i by Zuckernick generally enjoyed the Trade offs unit and cited 
the motivational aspect of the series, its ability to stimufate the students' interest, as its greatest asset. Thus, the 
series was very-' highly regarded by a most important audience, classroom teachers. 

Teachers surveyed by Roleke, Van Apeldorn, Vargo, and Zuckemick indicated some of the programs, particu-. 
larty the later ones, were too difficult for fourth- and fifth g rade students. Over a third (36/6) of the teachers surveyed 
by Roleke said some of the programs were too difficult for fifth-grade students (this finding was substantiated by 
his student survey in which 52% of the fifth-grade students indicated some of the programs were too difficult for 
them). Based on the data he had gathered. Van Apeldorn s steering committee recommended the series be used ' 
at the grade seven level. Zuckernick's follow-up study one year later concurred with Van Apeldorn's recom- 
mendation of grade seven use. Vargo stpjck a compromise by recommending the first eight programs be 
used with grades five and/or six and programs nine through fifteen be used with grades seven and/or eight. 

Finally, three investigators (Roleke, Van Apeldorn, and Zuckemick) surveyed students. Roleke found the 1 ,206 
students he surveyed had enjoyed the series and thought they had learned a lot about economics. However, as 
mentioned above. 52% of these fifth-graders indicated some of the programs were too difficult forthem. Van Apel- 
dorn s survey revealed that the majority of 225 students found the series to be easy to understand, interesting, and 
important to learn. Zuckemick found that the series increased the students positive attitude toward economics 
and the discussion of economic issues with parents and teachers. She also found that the series was. in compari- 
son with other classroom lessons, generally favorably received by students. 

Several areas have emerged from this review that suggest a need for further research. One of these areas is the 
effect the series has on teachers' knowledge of economics. Only two studies (Van Bockern and Stern) examinee' 
this f)s a vanable and they produced inconsistent results. Of course, one would have to consider the level of pre 
vious training in economics as a variable in a study of this type. Interestingly, Van Bockem's study showt. J 
significant increases in both student economic knowledge and attitude using only the series with no follow-up 
rKtivities or discussion. This suggests that even teachers untrained in economics can successfully use the series. 
Also, informrition from teacher surveys (Roleke, Van Apeldorn, and Vargo) suggests that some of the later 
proqrams are F>erceived by teachers as too difficult for fourth- and fifth-grade students. Of course, this would vary ^ 
with the ability levels of the students, but further research is needed to determine the most appropriate grade levels 
for different uses of the series. Fin^illy, more research is needed which examines students' understanding and irv. 
tf»rndli/ation of the decisionmaking model presented in the series. 

Ifi rone kjsion. the information reviewed has clearly indicated that use of the Trade-offs series significantly 
irn[)r( ivrs both studenfta^owledge of and attitudes toward econonnics. Furthermore, the evidence suggests that 
It.uh'nih r)lso jmproves teacher attitudes toward economics. This might be equally important to the student 
rcKjnitiVf.^ and ottitudinal gains, since teacher attitudes toward the so-called "dismal science" of economics have 
rrrjilitionally been very poor, f^inally. the studies reviewed here suggest that the series is very appealing to both 
tfVK hrrs and students, which should help to insure its continued use in classrooms throughout the (Jnited States 
r)t\d C.cKiadd The bulk of evidence has certainty supported the claim of Walstad and McFarlandthat "this series 
(vovides a sicjnifirant new resource for instruction in elementary social studies ' (p. 4 1 1 ). In light of the information 
wfiK fi h<is bvvn presented, it appears that this claim may be extended to the junior high levels as welL 
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NOTES 



^Ti'st of Flcmentan^ Economics, West Springfield 
Public SchcxDi. Economic Education Enrichment Program 
(New York: Joint Council on Economic Education. 1971 ). 
This test contains 29 items with a reliability of ,71 (K R 20). 

-The same semantic differential instrument was used as 
a pretest and posttest of student attitudes toward 
economics. The reliability of this instrument was .82 (Cron- 
bach Alpha) for intermediate elementary students. 

^Redmond. John. Tradeoffs Student Eviiluation 
(Greensboro, fiC: fiorth Carolina Council on Economic 
P ducation. 1 979). Reliability data were not presented for this 
lesf. 

•The Student's Economic Attitude Sua'ey had a test- 
retest r**l)ability (oneweek interval) of .86. Since only one 
form of this survey existed it was used for both pretesting 
find posttestincj. 

'•Vines. Carolyn. Questionnaire of Economic Under- 
stand inq (no information was presented by the author 
on the location or piiblication date of Dr. Vine s instru- 
merit.) An item-test homogeneity analysis revealed a co* 
efficient of 93. 

^Soper. John. Test of Economic Literacy (New York: 



Joint Council on Economic Education. 1 979). Forms A and 
B were used as pre* and posttest measures of teachers' 
economic knowledge. The reliability (using the Cronbach 
Alpha) is .875 for Form A and .872 for Fomn B. 

^Klockars, Aran J.. & Leonard. Ken. Tradeoffs Tesl 
revised edition, (Seattle: Washington State Council on 
Economic Education, 1979). 

®Shann, Mary E. Measuring Problem Skills and 
Processes in Elementary School Children (Boston Gniv.; 
School of Education. 1976). The test for problem giving 
ability was developed from Part II of this work. Reliability data 
were not presented for this instrument. 

"^Test of Economics in Trade offs (Missouri Council on 
Economic Education). Location, date of publication, and 
other pertinent data were not provided by the author. 

'^ogan. John. The Teaching Economics Test. This in- 
strument was adapted from William Walstad's (1978) 
dissertation work. Reliability data were not available. 

"Dawson. Donald G.. & Kilgore, John H. Primary Test of 
Economic Understanding (Iowa City. Iowa: University of 
Iowa. 1971). The reliability of the PTEU is .78 (Cronbach 
Alpha). 
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Comprehensive Chart of Studies Reviewed 



PRIINCIPAL 
AUTHOR LCK^TION 

William WciKtdd 
St Louis. Missouri 



SAMPLE aZE 

Students = 563 
(fihh and 
sixth graders) 
Teac:hi?rs = 24 



DESIGN/METHOD VARIABLES 



Stevo Van B<k kerr^ 
Sioux Falls. 
South Dakota 



Stuflents - 505 
(sixth (jraders) 
Teachers ^ 2 1 



Wilharii Polwrr 
VV'ishf M* C ujiifv 



Students 218 
(sixth fjraJfTs) 
ft'dchers ■ 8 



J.K k .(.'hl/fTVU 

' >h s« hi )* j| jjistrif 
♦hr< »U()linut \\u* 



((irrulrs 4 6) 



rHcnequivalent 
control group 
design 



Experimental; 
pre test/treat- 
ment/post test 
Control: pre test/ 
post lest 



INon equivalent 
control group 
dc»sign 



Data gatfiered 
in the procf'ss of 
validating an 
achievement test 
for econonnics 
(Fiasic FcO' 
nornics Test) 



1 ) Trade offs effects on 
students* economic 
knowledge and altitudes. 

2) In-service training of 
teachers for Trade offs 
use and its effects on 
student economic knowl- 
edge and attitudes. 

3) Multiple regression 
controlled for age. sex. 
achievement score, pre 
test economic linder 
standing and pre-test 
attitude toward 
economics. 



INSTRUMENTS 

Tesl ot 
Elcmentarif 
Economics 
( TEE) Investiga- 
tor-developed 
semantic differ 
ential for 
attitude scale. 



FINDINGS 

Both exp>erimental groups 
(viewing TradeOffs) showed 
significant improvennenl over 
control groups (not viewing 
Tradeoffs) In economic under- 
standing and attitudes toward 
economics. These gains were 
further increased with teacher 
In service training. 



1 ) Trade-offs effects on 
student and teacher 
economic knowledge and 
attitude. 

2) The effects of in service 
training for Trade Offs 
use on student and 
teacher economic knowl- 
edge and attitudes. 

3) Multiple regression 
controlled for: student 
pretest attitudes and 
knowledge, teacher pre 
test attitudes and knowl 
edge, reading scores. IQ. 
teacher post-economic 
preparation, sex. socio- 
economic background. 



1 ) Trade offs effects on 
economic understanding. 

2) The effecis of eco- 
nomic understanding on 
problem-solving ability. 

3) Tiade Offs effects on 
student attitudes toward 
free market, free enter 
prise, and big business. 



1 ) ffadeOlh C()cjniliv<» 
pfferts compared to otfier 
instruction. 

2) Length of instruction 
when /"/tf^cfJ/N is used 
compared to other 
instruction 



Student: Trcide- I ) Trade offs alone, with no 
Offs Student follow-up activities or discus* 
Eealuation, sion, had a significanL positive 
Investigator- effect on students* economic 
developed attitudes and knowledge, 

student's Eco- 2) Student gains in economic 
nomic Attitude understanding and knowledge 
Sun^eii were further increased with 

Teacher: teacher In-service training and 

Questionnaire follow up activities. 
of Econon}ic ^) Trade offs alone produced 
Understand- significant positive gains In 
ing, Test of teachers' attitudes toward 
Economic economics. These gains were 
Litaracii further increased with in-service 

training. 

4) Neither Trade offs alone nor 
in conjunction with the in- 
service workshop had a meas- 
urable effect on teachers* 
knowledge of economics. 



Tradeoffs 
lest. 

Adaptation of 
f^hasuring 
Problem Sole 
in^i Skills and 
f^focesscs in 
f IcfnetUarij 
S( /kk)/ Chtl 
drvn. Adaptation 
of Walstad^s 
semantic differ- 
ential instr.j 
rnent used to 
measure 
attitudes. 



1 ) Trade offs significantly 
improved students' economic 
understanding. 

2) Tradeoffs significantly 
increased positive attitudes 
toward free nnarket and free 
enterprise, but did not change 
attitudes toward big business. 

3) The results wher examining 
the effects of economic under 
standing on problem-solving 
ability were inconclusive: 
analysis of covariance revealed 
no significant differences while 
a multiple regression analysis 
revealed a significant regres 
sion coefficiwt. 



Students receiving Trade-Ofis 
instruction performed signifi 
( antly better than students 
receiving other instruction. 
Students receiving Tradeoffs 
instruction also received 
significantly more instruction. 
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PRINCIPAL 
AUTHOR LOCATION 

James Roteke 
Kdn?ias City. 
Missouri 

James Roleke 
Kansas City. 
Missouri 



Jarrtes Roleke 
Kansas City, 
Missouri 



Allen Sleni 

Minnedp<^)lis. 

Minnesota 



Allen Stern 

MinntMpolis. 

Minnes{>tci 



AIN'n Sti*rn 

MinntM|K)l>s. 

Minnesota 



P r)v<*lt»*villc. 
Afkdnsds 



Kffi V()n Apelclurn 
fintish 
< ( ilufTihui 
( ArM()A 



SAWPtE S<ZE 

Students ^.1400 
(mostly fifth 
grade) 

Students ^ 1206 
(mostly fifth 
grade students) 



deskjN/metmod variables 



Teachers - 225 



2'> elementary 
and middle 
schc>f)i teachers 



Students - 1 73 
(lourlh fjrade) 
Teachers ^ 8 



Students 63 
leathers - I 



Students 285 
((jrades 4. b. 
7) 

l('cJ( lUMS " 12 



Pre test/treat- 
ment/post test 

Survey 



Trade Offfi effects on 
students' economic 
knowledge. 

Trade offs' appeal to 
stu^lenis 



Teachers = 42 Survey 



Survey of 
teachers who 
had participated 
in a one-day 
workshop on the 
series. 

Pre test/treat 
rnent/post test 



F:j(perimental: 
pre test/treat 
ment/post test 
Control: pre test/ 
post test 

Pre test/treat- 
ment/post test 



Teachers 
attended a one 
day workshop 
after which they 
used the series 
with their classes 
Students and 
teachers corn 
pleted question' 
naires and 
teachers regu 
larly submitted 
comments to 
the project 
coordinator. 



rr(fc/c»-(Ws* appeal to 
teachers. 



INSTRUMEfiTS FIMDIMOS 

Test of Trade offs use increased 

Economics /n student scores by 18%. 
Tradeoffs, 

Investigator- 1 ) The students Indicated they 
developed enjoyed the series and thought 

survey. they had learned a lot about 

economics. 

2) Over half {52%) said some 
of the programs were too diffi- 
cult for thenn. 

Investigator- 1 ) The avef^vHelming rrjajority 
developed of teachers (98%) indicated the 

survey. series Was an effective instruc- 

tional tool. 

2) Over a third (36%) said 
some of the programs were 
too difficult for fifth grade 
students. 



Teachers perceptions of 
rrtu/rOfts' worth. 



Trade (Vf*^ effects on 
teachers* understanding 
and attitudes. 



TfddeOff'^ effects oh 
students' knowledge of 
economics when the 
series is used with trained 
teachers. 

Student knowledge of and 
attitudes toward eco 
nomics when Tradr Offs 
is used with a teacher 
untrained in economics. 



Student and teacher 
reaction to the scries. 



One question 
scale: Teachers 
rated series 
from "very 
worthwhile" to 
"worthless." 

Cognitive: Trsl 
of EcoT}omu 
I iteractj 
Altitude: 
Teaching Eco- 
nom/cs 7cs^ 

Primanj Test 
of F.conomtc 
Understand- 
ing. 



The majority of teachers 
(69.9%) rated the series "very 
worthwhile." The remaining 
teachars (30.1%) rated the 
series "worthwhile.** 

Teachers* knowledge of eco- 
nomics and attitudes toward 
economics were both signifi- 
cantly increased by the 1 2-day 
workshop (the treatment). 

Students using Trade offs 
exhibited significant grov^rth 
over and above the growth 
which occurred ip students 
using only traditional methods. 



Trade offs Students showed significant 
Student cognitive improvement when 

Evahiiitinn. Trade-Offs was used with a 
Investigator- teacher untrained in eco- 
developed nomics. Mo comparative data 

attitude scale. was available for the attitude 
scale, but students thougnt 
other students should see the 
series. 

Investigator- The response of the teachers 
developed and students to the series was 

q lestionnalre. overwhelmingly positive. Since 
some of the later programs 
were too difficult for fourth and 
fifth graders, the steering 
committee recommended it be 
used at the grade seven level. 
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AUTHOR LOCATION 

Arlene Zukernick 
Firilish Columbia. 
CAINADA 



SAMPLE G\Zl:. 



DESIGN/MrrHOD VARIABLES 



15 



Students = 
(grades 4-7 
and 9) 

Teachers ' 15 



Michael Watls 

Iruilcinapoli*?, 

Indiana 



TccK'hrrs * 39 



[-kvinj ir Varfjo 
Sarnia. Ontario 
CAPHADA 



14 lodchers 



Surveys at pre-, 
mi(; , and post- 
viewinc). Pre test, 
checklist after 
each lesson, final 
questionnaire. 



Participants 
viewed each 
program in the 
series and rated 
it. They also- 
rated the entire 
series and the 
Teachers 
Manual. 



Personal con- 
tacts witl. 
teachers and 
written com- 
ments provided 
by teachers. 



Student and teacher 
reaction to the scries. 



Multiple regression 
analysis exarpined scores 
on the Tc^t of t'conomic 
L itcidCif. whether or not 
they had^att.^i(V!ed a 
workshop on. economic 
educati<in« sex, grades 
taught and reading level 
in their classes. 



Teachers' subjective 
reactions to the series. 



iNSTRaMENTS 

Investigator- 
developed 
surveys. , 



Investigator 
developed 
rating scale.. 



Open-ended 
question/iair^? 
and per^isla^^ I 
con^c1» with 
teachers. 



RNDINCS 

1 ) JrddcOlfs inc eased stu- 
dents positive attitude toward 
economics and their actual 
discussion on economic issues. 

2) There also was a significant 
increase in the ^tud^nts' self- 

* perception of hqw /nuch they 
learned during the courjse of 
series. ' \ 

3) Teacher^ indicated tne 
imolivational aspect c^f ^ne films 
to stimulate students /interest 
was its greatest asset 

4} They indicated t^iey thought 
grade 7 was the niost appropri- 
ate grade for implementation 
of the series. 



1 ) On Q five-point scale (5 
being the best pbssible 
ranking) the series was rated 
4.2' by thi^s^ participants. , 

2) They rated the Teachers 
Manual as useful and usable.' 

3) They rated the content of 
the series as important and 
effedively presented and 
strongly indicated they y/ould 
use the series. 



1 ) TJui^pnsensus of these 
t^acners was that the series 
was highly useful, appealing, 
and stimulating. 

2) The recommendation 

was made to use the first ei^Ht 
programs with grades five and/ 
or six and programs nine 
through fifteen With grades 
seven and/or eight. 
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AGENCY FOR INSTRGCTIONAL TELEVISION 
Box A, Bloomington, Indiana 47402 
812/339-2203 

AGENCY FOR INSTRUCTIONAL TELEVISION, a nonprofit American-Canadian organization estab- 
lished in 1 973 to strengthen education through television and other technologies. Its prinriary function 
IS the developnnent of joint progrann projects involving state and provincial agencies. It also acquires, 
adapts, and distributes a wide variety of television, audiovisual, and related print nnaterials for use as 
nnajor learning resources. AITs predecessor organization. National Instructional Television, was 
founded in 1 962. The AIT nnain offices and nnidwestern office are in Bloonnington. Indiana. Thfere are 
regionai offices in the Atlanta. San Francisco and Washington, D.C. areas. 

CANADIAN COGNCIL FOR ECONOMIC EDGCATION 
252 Bloor Street West, Toronto, Ontario M5S 1V5 
416/968-2236 

CANADIAN FOUNDATION FOR ECONOMIC EDUCATION . a federally-chartered nonprofit organiza- 
tion dedicated to strengthening econonnics instruction in Canada. It ainns to pronnote greater eco- 
nonnic awareness by assisting and encouraging the educational systenns to innprove the quality and 
rxpfjncl the quantity of econonnics now being jtaught in Canadian elementary and secondary schools. 
The Foundation produces educational nnaterials and provides resources and programs to facilitate 
the tear hinq of econonnics and econonnic^-related subjects throughout the country. 

JOINT COCJNCIL ON ECONOMIC EDUCATION 
1212 Aveaue of the Americas, New York, New York 1 0036 
212/582-5150 

JOINT COUNQL ON ECONOMIC EDUCATION, an independent, nonprofit, nonpartisan, educa- 
tional orqani^c^tion incorporated in 1 949 to encoL ^age. innprove. coordinate and service the econonnic 
education movement. Its principal nnediumforexpandingand improving economic education is a net- 
work of Affiliated Councils functioning at the state level and Centers for Economic Education on col- 
leqe and university campuses. The American Economic Association and American Association of 
Colleqes for Teacher Education are formally affiliated with the Joint Council, as are other national 
professional groups concerned with economic education. 
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